Partitioning Input Space for Reinforcement Learning for Control
نویسندگان
چکیده
This paper considers the effect of input-space partitioning on reinforcement learning for control. In many such learning systems, the input space is partitioned by the system designer. However, input-space partitioning could be learned. Our objective is to compare learned and fixed input-space partitionings in terms of the overall system learning speed and proficiency achieved. We present a system for unsupervised control-learning in temporal domains with results for both fixed and learned input-space partitionings. The trailer-backing task is used as an example problem.
منابع مشابه
Modular SRV Reinforcement Learning Architectures for Non-linear Control
This paper demonstrates the advantages of using a hybrid reinforcement–modular neural network architecture for non-linear control. Specifically, the method of ACTION-CRITIC reinforcement learning, modular neural networks, competitive learning and stochastic updating are combined. This provides an architecture able to both support temporal difference learning and probabilistic partitioning of th...
متن کاملPartitioning Input Space for Control-Learning
This paper considers the eeect of input-space partitioning on reinforcement learning for control. In many such learning systems, the input space is partitioned by the system designer. However, input-space partitioning could be learned. Our objective is to compare learned and programmed input-space partitionings in terms of the overall system learning speed and proociency achieved. We present a ...
متن کاملHierarchical Neuro-Fuzzy Systems Part II
This paper describes a new class of neuro-fuzzy models, called Reinforcement Learning Hierarchical NeuroFuzzy Systems (RL-HNF). These models employ the BSP (Binary Space Partitioning) and Politree partitioning of the input space [Chrysanthou,1992] and have been developed in order to bypass traditional drawbacks of neuro-fuzzy systems: the reduced number of allowed inputs and the poor capacity t...
متن کاملHierarchical Functional Concepts for Knowledge Transfer among Reinforcement Learning Agents
This article introduces the notions of functional space and concept as a way of knowledge representation and abstraction for Reinforcement Learning agents. These definitions are used as a tool of knowledge transfer among agents. The agents are assumed to be heterogeneous; they have different state spaces but share a same dynamic, reward and action space. In other words, the agents are assumed t...
متن کاملAutomatic Partitioning for Multi-Agent Reinforcement Learning
This paper addresses automatic partitioning in complex reinforcement learning tasks with multiple agents, without a pri-ori domain knowledge regarding task structures. Partitioning a state/input space into multiple regions helps to exploit the diierential characteristics of regions and diierential characteristics of agents, thus facilitating learning and reducing the complexity of agents especi...
متن کامل